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A  SURVEY  AND  COMPARISON  O'-  METHODS  FOR  DETERMINING 
CONFIDENCE  BOUNDS  ON  SYSTEM  RELIABILITY  FROM  SUBSYSTEM  DATA* 


Nancy  R.  Mann 

Rocketdyne ,  North  American  Rockwell 
Canoga  Park,  California  9HOA  ,  U.S.A. 

In  this  paper,  methods  of  obtaining  lower  confidence  hounds  on 
the  reliability  of  nnn-mn intained  systems  are  surveyed,  and  numerical 
comparisons  are  given.  It  is  assumed  that  failure  data  have  been 
collected  from  life  tests  performed  on  prototypes  of  the  various  sub¬ 
systems  which  make  up  the  system,  but  that  the  system  has  not  been 
tested  as  a  whole,  for  some  particular  reason.  The  reason  may  be,  for 
example,  expense  or  simply  that  it  is  virtually  impossible  to  test,  the 
entire  system  without  destroying  it.  Methods  applicable  to  series  and/ 
or  parallel  and  more  logically  complex  systems  are  discussed. 

OPTIMUM  CONFIDENCE  BOUNDS  FOR  SPECIFIC  SYSTEM  MODELS 

There  are  two  types  of  models  for  which  one  can  theoretically  cal¬ 
culate,  from  subsystem  failure  data,  confidence  hounds  on  system 
reliability  which  are  known  to  lie  optimum  in  some*  sense.  For  a  series 
system  made  up  of  k  independent  subsystems  each  having  exponentially 
distributed  failure  time,!',  there  exists  a  lower  confidence  bound  which 
is  most  accurate  (has  the  highest  probability  of  being  close  to  the  true 
system  reliability)  for  nil  values  of  system  reliability  among  exact  bounds 
which  are  unbiased.  (A  family  of  lower  confidence  hounds  0  (.X.)  on  0  at 
confidence  level  1-a  is  unbiased  if  Prob  [0 (x)s0 '1^1-a  for  all  0'  <9  and 
for  all  values  of  nuisance  parameters.  The  restriction  of  unbiasedness 
is  necessary  here  because  of  the  nuisance  parameters  X,,  . ...  \  ,  the 
failure  rates  for  the  k  independent  subsystems.)  For  this  model,  series 

system  reliability  U(  t  )  at  time  t  ■'»0  is  canal  to  —  exp(-t  >  )  = 

.k  m  m  ,j=l  m.l 

exp(-t  4,  X.),  X  >0.  ,j  I,  ...,  k,  so  that  one  can  also  think  of  obtaining 
1,1 .1  =  1  'I  •)  \ 

an  upper  confidence  hound  on  system  failure  rate,  </> -I  x 

,i=l  •! 


*The  writing  of  this  paper  was  sponsored  by  the  Air  Force  Office  of 
Scientific  Research.  AFSC,  USAF  under  Contract,  FVi(>i>0-71-C-()0*J0.  Work 
of  the  author  described  in  the  paper  was  supported  in  part  by  this 
contract  and  in  part  by  tin*  North  American  Rockwell  Interd ivi siona 1 
Technology  Program,  Mathematics  and  Statistics  Technical  Panel. 


The  optimum  lower  confident  hound  on  series-system  reliability, 
derived  for  two  subsystems  with  exponential  failure  data  by  Lentner  and 
Buell  ler  (l%3)  and  generalized  to  te2  subsystems  by  El  Mawnz.iiiy  ( lhtn ) , 


depends  upon  the  assumption  that  for  the  jth  subsystem,  n.  prototypes 


have  been  tested  until  r.,  with  lsr.^n.,  failures  occur,  j=l,  ...,  k. 


One, observes  for  the  Jth  subsystem,  t.  . ,  i — 1 ,  r.,  and  computes 

t.  .  +  (n.-r.)t  .  , ,  j  =1  ,  ...,  k.  Calculation  of  a  confidence  bound 
,1  i  =  l  i  .,1  ,1  .1  •’  •  .1 

by  El  Mawaziny’s  method  must  he  performed  iteratively  on  a  computer, 


and  if  the  product  of  the  number  of  subsystems  and  the  total  number  of 
failures  is  large,  problems  of  loss  of  precision  result.  See  Mann  (l97d). 


The  other  system  model  for  which  a  method  of  obtaining  optimum 
confidence  bounds  on  system  reliability  has  been  derived  is  one  in  which 
binomial ly  distributed  a  tt  rjjbujj?  or  pass-fail  data  are  collected.  No 


assumptions  are  made  concernin'!  the  form  of  failure-time  distributions; 


the  assumptions  are  that  the  system  is  serial  or  paral 1 e 1- redundant  ,  the 
subsystems  and  the  subsystem  prototype  tests  are  independent,  the 
failure  distribution  for  any  specified  subsystem  is  the  same  for  each 
prototype  of  that,  subsystem  tested  and  the  duration  of  each  test  is  the 
intended  operatin'!  time  applying  to  the  particular  subsystem  in  the 
system.  For  the  binomially  distributed  data  obtained  for  this  model, 

Bueli ler  (l 93?)  defines  a  smal 1 -sample  method  of  obtainin'!  confidence  bounds 


on  system  reliability.  These  bounds,  however,  like  binomial  confidence 


bounds  for  a  single  component,  are  conservative  in  general  rather  than 


exact  because  of  the  discreteness  of  the  numbers  of  failures.  In  order 


to  obtain  a  confidence  bound  which  is  exact  in  general  and  uniformly  most 
accurate  unbiased,  a  random  number  uni  formlv distributed  on  (0,l)  must  be 
generated  and  used  in  calculating  t lie  bound.  (Confidence  bounds  which 
depend  upon  a  uniform  random  variate  in  addition  to  the  failure  data  will 


be  referred  to  as  randomized .  while  the  conservative  bounds  which  do  not 


depend  upon  a  generated  random  number  will  be  called  nunrandomized . ) 


Lipow  and  Ili  ley  ( 1  t)r>*  > )  have  used  Buehler's  definition  to  compute 


and  tabulate  nonrandom i zed  lower  confidence  bounds  on  series  system 


reliability  It  for  systems  containing  one,  two.  or  three  subsystems  and 
s 


attribute  subsystem  data.  In  all  of  their  tabulations,  the  number  n  of 
items  tested  is  the  same  for  each  component  because  of  the  problem  of 
ordering  the  failure  combinations  in  calculating  each  confidence  bound. 


iPmu,uM,i.p  «>» uiwwwwifj 
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The  value  of  n  ranges  from  7  to  <everal  hundred.  The  number  of  failures 
is  not  required  to  be  the  same  for  each  component  and  ranges  from  zero  to 
about  n  2.  The  tabulated  lower  confidence  founds  on  series  system 
reliability  are  known  to  be  optimum  (correspond  to  shortest  intervals 
with  plus  one  as  an  upper  bound)  among  nonr andomized  confidence  bounds 
based  on  the  subsystem  attribute  data  for  two  independent  subsystems  when 
the  sum  of  the  numbers  of  failures  is  less  than  2  Jn.  For  three  sub¬ 
systems,  the  problem  of  ordering  the  failure  combinations  prevents  the 
authors  from  claiming  optimality  for  the  bounds  based  on  their  particular 
ordering  of  the  failure  combinations.  Stork  (l'lp?)  gives  in  graphical 
form  the  same  sort  of  conservative  nonrandomizod  confidence  bounds  for 
parallel-system  reliability  R  ,  for  systems  composed  of  two  independent 
subsystems  and  at  most  one  observed  failure. 

APPROXIMATE  AND  NON- OPTIMAL  EXACT  CONFIDENCE  BOUNDS 
FOR  THE  EXPONENTIAL  MODEL 

For  each  of  these  system  models,  there  are  a  number  of  methods 
that  have  been  derived  for  approximating  the  optimum  bounds.  In  some 
cases,  the  approximations  were  derived  before  the  optimum  bounds.  In 
other  cases,  they  were  derived  because  of  the  problem  involved  with 
calculating  the  optimum  bounds. 

For  the  exponential  series-system  model,  the  method  of  Kraemcr 
(l903)  yields  bounds  which  are  exact  and  depend  upon  only  the  smallest 
sample  mean  subsystem  failure  time.  This  method  gives  confidence  bounds 
which  are  very  inaccurate  (i.e.,  they  exhibit  a  high  probability  of  being 
far  from  the  true  system  reliability)  unless  one  failure  only  occurs  for 
either  every  subsystem  or  every  subsystem  except  one.  In  these  two 
special  cases,  Kraemer's  method  gives  the  optimum  confidence  bounds  under 
certain  conditions. 

Tli 0  methods  of  Sarkar  ( 1  <>7 1  )  and  Lieberman  and  Ross  ( 1  f>7 1 ) .  devel¬ 
oped  for  the  exponential  series-system  model,  depend  upon  combinations  of 
failure  times  selected  from  the  various  subsystems  rather  than  the  suffi¬ 
cient  statistics,  Z, , . . .  ,  Z.  ,  observed  as  z ,  ,  ....  z.  .  As  Lieberman  and 

1  k  1  k 

Ross  (l97l)  point,  out,  in  using  their  method  one  can  obtain  different 
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bounds  by  ordering  the  subsystem  t<  its  differently,  and  thus  combining 
the  subsystem  test  data  differently.  The  confidence  intervals  of 
liebcrman  and  Ross  are  exact  and  stochastically  shorter  in  general  than 
those  of  both  Sarkar  and  Kraemer. 

Grubbs  (l(j69)  uses  what  will  be  called  here  the  fiducial  approach 
to  approximate  the  distribution  of  series-system  failure  rate,  given  the 
exponential  subsystem  failure  data.  That  is,  he  assumes  that  since  the 
distribution  of  2*.  is  \  .W(2r.),  then  is  distributed  a*  XT  (2r .  )/2z  . , 
j_l)  1<.  Grubbs  employs  an  approach  which  uses  the  mean  S^’j/  z  j 

and  variance  JC  r./z  2  of  the  fiducial  distribution  of  system  failure  rate 

k  ,1=1  '1  .1  •  -  ,  . 

4>  \  to  fit  a  noncentral  Chi-square  distribution. 

Burnett  and  Wales  ( 1 9t *  1  )  and  Levy  and  Moore  ( 1 9(>7 )  suggest  for 
this  series-system  model,  and  also  for  other  models  which  are  more 
logically  complex  than  a  series  system,  Monte  Carlo  simulation  of  the 
fiducial  distribution  of  system  reliability,  given  the  subsystem  failure 
data.  Such  an  approach  yields,  for  the  series-system  model  essentially 
the  same  result  as  the  method  of  Grubbs;  see  Mann  (l9?o)  and  Grubbs  ( 1 97 1 ) • 
The  fiducial  approach  is  equivalent  to  obtaining  Bayesian  bounds  on  system 
reliability  at  time  t|n  with  the  prior  density  for  the  jth  subsystem 
failure  rate  X  .>0  equal  to  ,  ,i=1>  •••>  k’ 

Although  lower  confidence  bounds  on  system  reliability  obtained 
by  the  fiducial  method  are  optimum  for  one  subsystem  and  approach  the 
optimum  confidence  hounds  as  the  numbers  of  failures  increase  for  all 
subsystems,  they  are  conservative  in  general.  That  is,  for  (Ins  series- 
system  model,  the  fiducial  lower  hound  on  system  reliability  is  always 
less  than  the  corresponding  optimum  exact  classical  lower  confidence  bound , 
and  sometimes  by  a  considerable  amount.  This  ran  he  seen  m  lahlo  1. 

The  confidence  hounds  on  series-system  reliability  derived  by  tl 
Mawaziny  and  Bueliler  (l<)<>7)  f»r  exponential  model  depend  upon  the 

asymptotic  normality  of  system  failure  rate,  given  the  subsystem  data  as 
it  is  assumed  given  in  the  derivation  of  the  optimum  hounds  of  HI  Mawaziny 

That  is,  one  assumes  ,  and  'V  *  ]~7o . nk"/'rZk’  °  B,VPn’  v'1,01!' 

the  subscript  1  is  arbitrarily  assigned.  As  shown  in  Table  1,  a  lower 
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confidence  bound  obtained  by  this  method  is  always  greater  than  the 
correspond i ng  optimum  bound  when  the  number  of  failures  is  small  lor  any 
subsystem.  One  of  the  most  serious  problems  inherent  in  this  method  of 
obtain inp:  lower  confidence  bounds  on  system  reliability  is  that  subsystems 
for  which  a  single  failure  occurs  are  ignored.  The  consequences  of  this 
fact  are  exhibited  in  Table  1. 

The  methods  of  Rosenblatt  (l%l)  and  Madansky  (l%r>)  yield  asymp¬ 
totic  lower  confidence  bounds  on  series-system  reliability  wlucn,  like 
the  method  of  HI  Mavaz iny  and  lluebler,  tend  to  be  very  much  too  large 
w|1Cn  only  a  single  failure  occurs  for  any  subsystem.  These  methods  are 
discussed  in  more  detail  in  the  section  dealing  with  confidence  bounds 
based  on  binomial  subsystem  data. 


The  Approximately  Optimum  confidence  bounds  of  Mann  and  Orubbs 
(1072)  arc  based  on  a  combination  of  the  approach  of  Grubbs  (1071)  and 
that  of  HI  Mown/,  iny  and  lluebler  ( l‘H>7 )  r«r  Hie  exponential  series-system 

model.  One  conditions  on  .  and  »2 . u,. .  as  in  deriving  the  optimum 

confidence  hounds  on  11^  and  determines  expressions  for  the  approximate 
conditional  mean  and  variance  of  system  failure  rot p<f>.  The  conditional 
variate  Zj, given  u,  belongs  to  the  Koopman-Darmo  is  exponential  family  with 

parameter  <p  and  nuisance  parameters  . Xj..  «n  that  b\  the  discussion 

given  by  Lehmann  (l‘F)‘),  sec.  ’i.l),  a  uniformly  most,  accurate  unbiased 
upper  confidence  hound  for  <p  can  he  obtained  from  /.^  and  _u. 


Once  the  approximate  conditional  mean  and  variance  of  system  failure 
rate  are  calculated,  one  can  approximate  very  accurately  the  noncentrnl  U11- 
square  conditional  distribution  of  system  failure  rate  by  another  central 
Chi-square  distribution  [see  Putnnik  (l‘>’,‘>)]  and  thus  obtain  approximately 
optimum  lower  confidence  bnuiuls  on  series-system  reliability.  A  Wilson 
Hi  1  forty  (lOTl)  approximation  of  Chi-square  by  a  Gaussian  variate  can  he 
used  to  facilitate  the  calculations  when  noninteger  degrees  of  freedom  are 
encountered.  The  expressions  for  the  conditional  mean  m  and  variance  v 
of  system  failure  rate  p  derived  by  Mann  and  Grubbs  have  been  simplified 

by  Mann  ( 1  f>7— )  «md  ar<> 

k 


m  =  N'  (r  .-  1  )  z  ,  +  z 
,j  =  l  .1  .1 


1 


(1) 


(1) 


TABLE  1.  LOWER  50$,  ?jri,  AND  90^  CONFIDENCE  BOUNDS ,  ON  SERIES- SYSTEM  RELIABILITY : 
EXPONENT LYL  SUBSYSTEM  FAILURE  DATA  ,  WITH  MISSION  TIME  t  =  1 
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v  (r.-l)/z.“  +  z,  (: 

j=l  .1  .1  U) 

where  z^^  is  the  smallest  of  the  z's.  To  approximate  the  optimum 
lower  hound  on  11^(1^)  at  confidence  level  1-a  using  the  Wi  1  son-lii  1  forty 
transformation,  one  calculates 

BJO  =  pxP  “ 1  mrt»  jl-v/Ojm2)  +  Zj^v1  J/(lm)  !  ,  (' 


where  Z  is  the  lODyili  percentile  of  a  standard  normal  distribution. 

Confidence  hounds  based  on  formulas  (l),  (il)  and  (?)  are  compared  in 

Table  1  with  the  optimum  classical  exact  confidence  hounds  of  El  Mawa/iny 

and  with  the  fiducial  bounds  and  the  asymptotic  approximation  of  El 

Mawa/iny  and  Buckler.  The  data  used  for  the  comparisons  were  generated 

in  conjunction  with  the  study  described  by  Mann  (ID70).  The  Approximately 

Optimum  lower  confidence  hounds  11  (t  )  on  It  (t  )  agree  to  within  about  a 

— s  m  s  m 

unit  in  the  second  decimal  place  with  optimum  lower  confidence  bounds  of 
El  Mnwa/inv  ( l(Mn ) . 


APPROXIMATE  AND  NON- OPTIMAL  EXACT  CONFIDENCE  HOUNDS 
FOR  THE  BINOMIAL  MODEL 

For  series  or  parol  1  el- redundant  models  and  the  case  in  which 
only  pass-fail  binoinially  distributed  data  are  collected  for  each  sub¬ 
system,  many  methods  involving  large-  or  small-sample  approximations  or 
Bayesian  techniques  have  been  derived  for  obtaining  nonrandomized 
confidence  bounds  on  the  probability  of  successful  operation  of  a  system. 
Among  the  large-sample  methods  is  one  derived  by  Madanskv  (I'Hn). 

Extension  of  Madanskv' s  method  to  logically  complex  systems  has  been 
accomplished  by  Mylire  and  Saunders  (lfX>8b).  In  using  this  method,  one 
parameterizes  so  as  to  determine  iteratively  parameter  values  which  make 
the  negative  of  the  logarithm  of  the  likelihood  ratio  equal  to  one  half 
of  a  specified  percentile  of  the  Chi-square  distribution  with  one  degree 
of  freedom;  see  Wilks  (lT?8).  In  determining  the  likelihood  ratio  by 
this  method,  one  must  maximize  the  joint  binomial  density  function  sub¬ 
ject  to  a  constraint,  specified  by  the  equation  relating  system  reliability 
to  the  suhsvstem  reliabilities. 
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The  principal  disadvantage  associated  with  use  of  the  likelihood- 
ratio  procedure  is  that  any  component  exhibiting  zero  failures  in  a 
life-test  situation  is  ignored  in  the  determination  of  a  series-system 
reliability  confidence  hound  and  tends  to  bias  parallel  system  confidence 
bounds  on  the  high  side.  Thus,  the  procedure  yields  lower  confidence 
hounds  that  are  too  high  whenever  zero  failures  are  observed  during  the 
life  test,  no  matter  how  large  the  sample  size  for  all  components.  This 
method  is,  in  fact,  not  appropriate  for  highly  reliable  systems. 

Another  method  suggested  for  obtaining  confidence  bounds  on 
system  reliability  is  one  based  on  the  asymptotic  normality  of  the  un¬ 
biased  simulation  estimator  (often  equivalent  to  the  maximum- 1  ikcl  ihood 
estimator)  of  system  reliability.  Such  a  procedure  and  its  theoretical 
rationale  are  discussed  at  length  by  Rosenblatt  (W).  Easterling 
(10712)  investigated  a  variation  of  this  procedure  in  which  psuedo  numbers 
of  system  tests  and  successes  are  determined  from  the  estimate  of  the 
variance  of  the  max i mum- 1  ike  1 i hood  estimator  of  system  reliability. 

These  numbers  are  then  substituted  into  the  incomplete  Beta  function,  and 
confidence  hounds  obtained  as  in  determining  usual  optimum  nonranoonnzed 
confidence  hounds  for  a  single  component  and  binomial  sampling. 

Easterling  found  his  approximation  to  he  better  for  several  series, 
parallel  and  series-parallel  systems  which  he  investigated  than  that 
based  on  the  asymptotic  normality  of  max  imam- 1 ikcl  ihood  estimators  and 
comparable  to  that  based  on  the  asymptotic  Chi-square  distribution  of  the 
logarithm  of  the  1  ike  1 ihood- rn t io  function  (which  is  more  diflicult  to 

implement ) . 

Woods  and  Bursting  (l‘H»n)  have  approximated  the  distribution  of 
-2  f  n  R  ,  with  U,  the  max  imum- 1  ikcl  ihood  estimator  of  sei  ies  s>h4,m 
reliability.  l,y  a  cent  im.ity-correeted  (lamina  distribution.  The  approxi¬ 
mation  appears  to  give  exact  bounds  when  sample  sizes  are  large,  hut 
does  not  appear  to  perform  well  for  sample  sizes  as  small  as  10. 

March  land  and  Weber  (1072)  describe  a  method  similar  to  that 
detailed  by  Rosenblatt  for  obtaining  confidence  hounds  on  the  reliability 
of  a  complex  system.  These  authors,  however,  suggest  the  use  of  Chobyshov 
inequalities  rather  than  settling  on  any  particular  assumptions  concerning 
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the  d  is  tr  i  hut  i  on  (asymptotic  or  <  lierw  isc)  of  the  unbiased  simulation 
estimator  of  system  reliability,  and  their  hounds  involve  the  expression 
for  the  exact  rather  than  the  asymptotic  variance  of  t lie  estimator  of 
It  .  Their  procedure  presents  no  particular  computational  difficulties 
as  lung  as  the  system  remains  logically  simple.  Calculation  of  their 
variance  estimate  for  the  reliability  estimator  heroines  very  complicated, 
however,  as  the  system  increases  in  complexity. 

A  more  serious  difficulty  inherent  in  this  method  and  ail  methods 
dependent  upon  the  maximum- 1  ike  1 ihood  or  simulation  estimator  of  system 
reliability  is  similar  to  that  given  for  the  1  i  ke  1  i  hood- rat  i  o  method. 

It  is  the  fact,  that  any  component  exhibitin';  no  failures  during  the  life 
tests  is  ignored  in  the  determination  of  hounds  for  strictly  serial 
systems  and  yields  a  lower  confidence  hound  on  parallel  -  system  reliability 
that,  is  always  unity.  The  max  imum- 1  i  kcl  ihond  and  sinulation  estimators 
are  also  inappropriate  for  providing  the  basis  for  confidence  hounds  on 
the  reliability  of  highly  reliable  systems. 

Table  2  gives  for  series  systems  the  optimum  nonrandom i /ed 
confidence  hounds  of  Lipow  and  Ililev  (l9~‘)),  1  ike]  ihond- rat  in  (iJt)  and 
max i mum- 1  ike l i hood  (ML)  approximations  calculated  by  Mylire  and  Saunders 
(lObHa)  and  Easterling's  modified  maximum  likelihood  (MM!/!)  approximations, 
all  for  data  sets  in  which  at  least  one  failure  occurs  for  each  component. 
Results  based  on  the  Woods  and  Bursting  approximation  are  shown  in  Table  3. 

Small-sample  approximate  confidence  hounds  on  11^  for  an  independ¬ 
ent  series  system  and  binomial  data  have  been  derived  by  Garner  and  Vail 
( 1 ‘Mil  )  ,  Connor  and  Wells  (iBti'j),  Abraham  (l(X>2),  and  Li  nils  tram  and  Madden 
[see  Lloyd  and  Lipow  (l<H)2)".  The  first  two  of  these  approaches  use 
various  methods  of  combining  confidence  hounds  on  subsystem  reliability 
to  obtain  the  desired  hounds  on  system  reliability.  The  other  two  uso 
binomial  or  Poisson  approximations  for  certain  statistics.  Some  of  these 
methods  are  sensitive  to  inctpiality  of  sample  sizes  for  subsystems. 

Lower  confidence  hounds  obtained  by  most  of  t  liese  approximate  methods 
have  been  compared  by  the  use  of  three  sets  of  data  by  Schick  and  Prior 
(lObb)  with  optimum  nonrandom i zed  hounds  obtained  using  results  of  Lipow 
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and  Hi  lev  (l‘n<)).  The  data  apply  t  series  systems  composed  of  two  sub¬ 
systems,  and  in  each  of  the  three  eases  the  sample  sizes  are  equal. 

Only  the  Lindstrom  and  Madden  method  compares  favorably  with  the  Lipow 
and  Riley  (l()V))  bounds.  The  Lindstrom  and  Madden  method,  however,  is 
one  which  is  sensitive  to  unequal  sample  sizes  for  subsystems. 


One  can  also  obtain  Bayesian  bounds  on  system  reliability  by 
choosing,  lor  a  system  composed  of  k  components,  a  prior  density  function 
for  the  j_t.li  component  reliability.  It..  ,j  =  l  ,  ...  .  k,  and  then  simulating 
(or  obtaining  through  a  Mel  1  in- transform  technique)  the  posterior 
distribution  of  system  reliability,  given  the  component  failure  data. 
Zimmer,  Prairie  and  Iireipohl  (l%'>)  and  Springer  and  Thompson  (l%(>) 
have  suggested  the  use  of  prior  densities  on  component  reliabilities 
that  are  uniform  on  (t),l).  Mastran  ( 1  <)(»H )  and  Parker  (l‘)7-)  prefer  to 
assign  prior  densities  in  such  a  way  that  the  prior  density  for  system 
reliability  is  uniform. 


Results  of  Ilniffa  and  Schlaifer  (lObl)  suggest,  that  any  prior 

density  approximating  the  prior  yielding  an  optimum  confidence  hound 

should  he  improper  (i.e.,  be  such  that,  its  integral  cannot  be  made  equal 

to  unity  by  affixing  a  constant  factor)  as  is  the  prior  density  function 

p(lt)  =  R  ^  (or,  equivalently.  p(-fnR)  uniform  on  the  positive  half  real 

line)  associated  with  the  optimum  nonrandomi zed  binomial  confidence 

bound  for  a  single  component.  Results  of  Fertig  (l')7*0  and  Mann  (l()7R) 

relating  to  series  systems  with  exponential  subsystem  data  corroborate 

this  conjecture.  Their  results  show  further  that  for  the  exponent, ial 

model,  tin*  prior  densities  on  component  reliabilities  (which  wo  shall 

refer  to  henceforth  as  post  or i o t  prior  densities)  associated  with  the 

optimum  classical  lower  confidence  hound  on  series-system  reliability 

contain  component,  failure  data.  Tin*  Approximately  Optimum  lower 

confidence  hounds  on  R  based  on  the  conditional  mean  m  and  variance  v 

s 

of  system  failure  rate,  given  by  formulas  (l)  and  (-),  implicitly  depend 
upon  an  assumption  of  a  posterior  prior  density  for  \  .  of  X  .  “  '  ,i  ^  0)\ 
j=l  ,  ...,  k,  where  z^^  is  the  smallest  of  the  z's.  Finally,  results  of 
Mann  (  1 f )  7  3 )  indicate  that,  both  randomized  and  nonrandomi  zed  optimum 
confidence  bounds  for  the  reliability  of  series  and  parallel  systems  with 


I)  i  norti  i  ii  1  mill  ay  s  t 1*  mi  (lain  art'  assoc  i  tod  with  prior  densities  containing 
failure  data. 

Use  of  component-reliability  posterior  prior  density  functions 

which  are  nol  approximately  optimum  can  yield  Monte  Carlo  lower  confidence 

hounds  havino  a  high  probability  of  bein'!  inordinately  far  from  the  true 

system  reliability.  For  example,  if  one  uses  as  a  prior  for  il  .  p(]l  )  = 

-  i  .1  .1 

’  .1  1  '  h.  with  lol  ,  the  optimum  (iiniirandomi  zed )  prior  density 

for  1\  =  1  ,  then  the  lower  confidence  hound  rained  (referred  to  hence- 

ioi’tli  as  f_i  due  ial  hounds)  for  system  reliability  It  are  uniformly  lower 

than  the  optimum  nonrandoini zed  lower  confidence  bounds.  For  a  parallel 

system  the  difference  between  the  two  types  of  confidence  hounds  is  not. 

tar,'!e  unless  sample  sizes  n  .  ,j-l,  ....  k  are  very  small.  However,  one 

obtains  for  a  series  system  with  n.=10,  n„=0,  u_  =‘) .  x,  =‘ >  x  =1  and  x  =0, 

I  -'■>12  t 

where  the  x's  are  numbers  of  failures,  an  optimum  nonrandornized  lower 
confidence  hound  of  O.KPi  and  a  fiducial  hound  of  O.V18,  These  results 
are  shown  by  Mann  (  1  r>7 1  )  and  other  comparisons  with  optimum  nonrandornized 
confidence  hounds  are  shown  in  Tables  1  and  \ . 

Usinj!  a  hound  based  on  uniform  prior  densities  for  the  component 

reliabilities  is  equivalent  to  usinj!  the  fiducial  bound  with  n  ,  i  =  l. 

.1  ' 

«  each  increased  by  one.  Thus,  for  tin*  data  set  above,  the  hound 
based  on  uniform  priors  for  component  reliabilities  is  0. I87.  For  more 
discussion  coneerninj!  the  us"  of  uniform  prior  densities,  see  Mann  and 
Fart  i«j  ( 1  *)7— )  • 

Harris  ( 1  (>7 1  )  lias  derived  a  procedure  for  obtainin'!  nonrnndom- 
ized  and  optimum  randomized  confidence  hounds  on  produels  and  quotients 
of  Poisson  parameters.  Since  for  lame  sample  sizes  and  small  proba¬ 
bilities  the  Poisson  d i s t r i but i on  can  be  used  to  approximate  binomial 
distribui  ions,  Harris  lias  suggested  usinj!  his  randomized  results  to 
approximate  pa ra 1  I e  1  system  reliability  confidence  bounds  under  appro¬ 
priate  conditions.  The  appropriate  conditions  are.  of  course,  large 
sample  sizes  and  high  reliabilities  for  all  components. 

Harris  compares  numerically,  for  a  selection  of  Poisson  failure 
data  applying  to  parallel  systems  composed  of  two  subsystems,  bis 
Poisson  lower  hounds  and  the  Poisson  approximation  of  Buehler  (iHTT)  to 


tin*  optimum  uourumlorn i zed  lo\%or  re  ifiilonrc  bounds  on  U  •  Harris 
randomized  lower  confidence  hounds  on  H  are  optimum  (uniformly  most 
accurate  unbiased)  for  Poisson  data,  but  his  nonrandomi zed  lower 
confidence  bounds  are  extremely  conservative. 

The  method  of  Harris  is  rather  difficult  to  implement,  involving 
t be  calculation  of  the  percentiles  of  the1  modified  Bessel  function;  and, 
unfortunately,  there  is  no  procedure  hv  which  Harris'  hounds  can  he  made 
to  apply  to  at  least  moderately  reliable  series  systems  with  binomial 
subsystem  data. 

Mann  (1071)  has  used  the  approach  used  by  Mann  and  Grubbs  ( 1 97- ) 

for  exponential-subsystem  failure  data  to  approximate  both  optimum 

randomized  and  optimum  nonrandomi/.ed  lower  confidence  bounds  on  series- 

and  pnral  le 1 -system  reliability  for  systems  with  binomial  subsystem  data. 

For  sample  sizes  large  and  the  numbers  of  failures  small,  Mann's 

Approximately  Optimum  (AO)  randomized  lower  confidence  bounds  on  parallel 

system  reliability  It  n<*ree  very  well  with  t  ho  optimum  randomized  Poisson 
*  P 

bounds  of  Harris  (see  Table  u).  To  obtain  the  Approximately  Optimum 
randomized  lower  confidence  bounds  on  It  ,  one  first  calculates 


n  • 


'  '  1  V: 


(1  i) 


+  •  ')  X 


■.r>t  6/x; 


v  if')  = .  :  ( 1  /  i  Y 

P  .1=1  1=X  .  +1 


+  X/.  v.-  -  )  .  .,6 


I; 

^  6/x 


j  I  .1 


with  xqj  equal  to  the  smallest  of  the  \'s  and  6  equal  to  both  +1  and 
-1.  Then  m '  =  u  m  (l)  +  (l-u)  m  (-l)  and  v'  =  u  v  (l)  +  (l-u)  v  (-l) 

P  P  |)  |)  J)  P 

where  a  is  a  realizat  i on  of  a  random  variate  U  uniform  on  (o,l).  Use 

of  m1  and  v'  with  the  W  i  I  son-Hi  1  forty  (l')“l)  transformation  for  the 
P  P  ,  , 

approximate  nonceiitral  Chi-square  d  i  s  (  r  i  but  i  an  oi  -jJn(l-It  )  gives 


Prob  J  1  —It  £  exp  -in' 


-v'  (l  m')“  +  Z  fP  (3  m')  | 

P  '  | )  '  (J  P  p  i 


-  1  -a  , 


itli  Z  the  lOOvth  percentile  of  a  standard  normal  distribution. 


One  obtains  a  similar  api  •  ov  iniat  ion  to  optimum  exact  lower 
confidence  bounds  on  by  calculating  m  (f  )  and  v  (a)  [m  («)  :ind  v  (F) ) 
respectively,  with  x  .  replaced  by  n.-x.  and  X{  replaced' "by  n(  p!  ’ 
U.o  smallest  value  of  n.-x.,  .j  =  l,  ....  k]  .  One  then  substitutes' ,„(<>), 

“«  f0r  1_IV  *  for  V«  f"r  za’  ms(-D+(l-u)n.s(l)  for  m’  and 

's  "  \s(  ")\s(0  f°r  Vj'j  <o  olitain  the  AO  randomized  approximately 

exact  lower  confidence  bound  on  R,.  The  expressions  (/,)  and  «j)  gi  yen 
for  mp(ft)  and  vp(r  )  are  approximations  for  differences  of  po  lygommu 

functions ,  derivatives  of  the  logarithm  of  the  Gamma  function;  see  Mann 
and  Fert  i  g  (l  O72) . 

Expressions  for  and  ms  and  v  and  Vf)  from  which  Approximately 
Optimum  nonrandom) zed  lower  confidence  hounds  on  system  reliability  ran 
be  obtained  are  similar  to,  though  somewhat  more  complicated  than,  those 
given  by  formulas  ('1)  and  (r>) ,  respectively.  Table  2  gives,  for  a  series 
system  with  failures  occurring  in  all  subsystems,  comparisons  of  these 
confidence  hounds  with  the  optimum  nonrandomized  confidence  bounds  calcu¬ 
lated  by  Lipow  and  Riley  (lO)O),  those  based  on  the  1 i i.ei  ihood-ra  io  (lJt) 
and  maximum- 1  ikrl  ihnod  (ML)  approximations,  calculate.;  by  My  lire  and 
Saunders  (lMiPa),  and  that  based  on  tlie  modified  maximum-  i  ike]  i  hood  (MMLI 
approximation  of  Easterling  (l07l).  Table  1  gives  comparisons  of  the 
optimum  nonrandom i zed  lower  confidence  hounds,  the  AO  nonrandomized 
coni  identic  bounds,  fiducial  bounds  and  those  based  on  the  Gamma  approxi¬ 
mation  of  Woods  and  Berating  (l%8)  to  the  distribution  of  -?nR  with  R 
tlie  maximum- 1  ikelihood  estimator  of  series-system  reliability.  Table  h 
applies  to  parallel  systems  and  compares  optimum  nonrandomized  and  AO 

nonrandomized  lower  confidence  bounds  with  fiducial  hounds  on  R  . 

P 

fable  r)  applies  to  parallel  systems,  large  sample  siz.os  and 
small  numbers  of  failures,  and  exhibits  the  optimum  nonrandomized  Poisson 
lower  confidence  bounds  »,,  1^  of  Buehler  (l077),  U.e  optimum  "randomized" 
Poisson  bounds,  calculated  by  Harris  ( I «>71 )  from  his  formulas  by  using 
the  expected  value,  o,  of  a  random  variate  uniform  on  (0,l),  and  the 
nonrandomized  version  of  Harris’  lower  confidence  bounds  on  R  the 
bottom  of  the  range  of  possible  lower  confidence  bounds  to  be'obta i ned  by 
randomizing  with  his  method.  Also  show,,  in  Table  are  the  AO  lower 
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TABLE  " ■  NONRANDOMIZED  NT  TTY  PERCENT  LOWER  CONFIDENCE  ROUNDS 
ON  SERIES  SYSTEM  RELLARILITY  FOR  UNEQUAL  SAMPLE  SIZES 


No . 
Tests 

>f 

No.  of 

Fa i 1 uros 

n . 

1 

1 

i 

1 

t 

0 

in 

5 

10 

1 

II  10 
r>  1 0 


n.  ii,,  »_ 

-J _ j_r  -> 

1 0  5  5 

10  10  <> 

1 0  0  0 


0  0 


Opti¬ 

mum 

AO 

Fidu¬ 

cial 

Gamma 

■  r>’*7 
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confidence  bounds  of  Mann  ( 1 97 1 )  corresponding  to  the  optimum  nonrandom- 

ized  lower  confidence  hounds  on  It  and  the  optimum  "randomized"  lower 

P 

confidence  bounds  (calculated  by  setting  the  uniform  random  variate  U 
equal  to  .5  in  evaluating  nU  and  v ^ . 

METHODS  APPLYING  TO  COMPLEX  SYSTEMS 

For  binomial  subsystem  data,  several  of  the  methods  described 
above  for  application  in  particular  to  series  and  parallel  systems,  have 
been  used  to  obtain  confidence  bounds  on  the  reliability  of  logically 
complex  coherent  systems.  Coherent  systems  are  defined  here  as  defined 
by  Rirnbaum,  Esary,  and  Saunders  (1961);  i.e. ,  systems  which  if  they 
perform  when  a  given  set  of  components  perform  also  perform  when  a  set 
of  components  containing  the  given  set  perform  and  which  fail  when  all 
their  components  fail  and  perform  when  all  components  perform. 

Use  has  been  made  of  the  approximate  methods  of  Rosenblatt  (l%3)> 
Madansky  (l%3),  as  generalized  by  Myhre  and  Saunders  (l%8b),  Easterling 
(l97l)  and  Murchland  and  Weber  ( 1 972 ) ,  d  iscussed  earlier.  The  modified 
maximum  likelihood  (MMLl)  method  of  Easterling  probably  gives  as  good 
an  approximation  to  the  optimum  nonrandomized  confidence  bounds  as  any 
of  these  methods  (see  Table  2),  and  is  not  difficult  to  implement.  As 
noted  earlier,  however,  none  of  the  methods  based  on  the  likelihood 

A 

ratio  or  the  simulation  or  maximum- 1 ikelihood  estimator  11^  of  system 
reliability  should  he  used  if  the  system  is  highly  reliable  so  that  zero 
failures  are  exhibited  for  any  subsystem.  The  results  in  Table  3  apply¬ 
ing  to  the  Gamma  approximation  to  the  distribution  of  - j? nil  of  Woods  and 
Dors  ting  (1968)  d  emonstrate  how  zero  failures  are  ignored  in  the  appli¬ 
cation  of  these  methods  for  obtaining  lower  confidence  bounds  on  series- 
system  reliability,  and  Harris  ( 1 97 1 )  demonstrates  similar  results  for 
the  maximum- likelihood  and  likelihood-ratio  methods  applied  to  parallel 
systems . 

Monte  Carlo  simulation  procedures  have  been  used  widely,  though 
incorrectly,  for  obtaining  confidence  bounds  on  the  reliability  of  a 
logically  complex  coherent  system.  Because  of  the  fact  that  subsystem 
failure  data  appear  in  the  posterior  prior  density  functions  associated 
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with  optimum  conf  idence  hounds  fo1  series  and  parallel  aysicma,  a 
straightforward  Mon to  Carlo  approach  for  logically  complex  systems  seems 
infeasible  if  meaningful  confidence  hounds  are  to  he  obtained. 

A  new  approach  is  given  by  Mann  and  Fort  ig  (l'172).  J1  is  assumed 
that  for  a  logically  complex  coherent  system,  all  of  the  most  basic  sub¬ 
systems  which  are  made  up  of  effective  components  only  (earlier  called 
subsystems,  but  tested  as  a  single  unit)  have  been  identified.  It  is 
assumed  further  that  for  each  of  these  basic  subsystems,  either  m^  and  v^ 

or  m  and  v  applying  to  AO  nonrandomized  confidence  bounds  have  been 

P  |>  , 

determined,  accordingly  as  each  subsystem  is  series  or  parallel.  (One 

can  also  randomize  using  this  procedure  and  thus  calculate  various  values 

of  m',  v',  in'  and  v'.) 
s  s’  p  p 

The  next  step  is  to  consider  each  subsystem  for  which  means  and 

variances  have  been  calculated  as  a  single  effective  component  X'  i  til  an 

effective  number  11  of  prototypes  subjected  to  life  test  and  exhibiting 

*  ’  +  * 

an  effective  number  x  of  failures,  with  n  and  x  not  necessari lj 

•X  X 

integers.  Each  x  and  n  must  be  determined  iteratively.  Then,  having 

■X'  "X 

found  values  of  n  and  x  for  each  effective  component  applying  to  all 
most  basic  subsystems ,  these  new  data  are  combined  with  each  other  and 
with  the  failure  data  from  oilier  single  components  to  determine  effective 
component  sample  sizes  and  failure  numbers  for  I  lie  next  most  basic,  set  ot 
subsystems  in  the  total  system.  This  procedure  is  continued  until  the 
effective  failure  number  find  sample  size  are  determined  for  the  entire 
system.  The  details  involved  in  (he  process  are  given  by  Mann  and  Fertijj 

0‘>72). 

This  method  is  rather  difficult  fo  implement  if  the  system  is 
extremely  complex,  but  provides  an  approach  for  obtaining  confidence 
hounds  that  arc  approximately  optimum  for  any  coherent  system,  no  matter 


how  reliable. 
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